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(54) Video coding and decoding method and apparatus 

(57) An image coding apparatus comprises a sub- 
tracter for providing a difference image between an 
input image per coding unit and a reference image gen- 
erated from a coded image which has already been 
coded; an image transformer for receiving, as an input 
image to be transformed, one of the input image per 
coding unit and the difference image, and performing a 
prescribed transformation to the input image to be 
transformed, thereby to obtain a transformed image; a 
quantizer for quantizing the transformed image by one 
of a prescribed quantization scale and a modified quan- 
tization scale which is given from a quantization scale 
decision unit described later, thereby to obtain trans- 
formed and quantized coefficients; an encoder for cod- 
ing the transformed and quantized coefficients to obtain 
coded data; a local characteristic value calculator for 
obtaining a complexity index value from the input image 
to be transformed and, using the complexity index 
value, calculating local characteristic values which are 
used for modification of the quantization scale; a control 
information set unit for setting control information which 
is used for modification of the quantization scale; and a 
quantization scale decision unit for modifying the quan- 
tization scale using the quantity of the coded data out- 
put from the encoder, the local characteristic values 
calculated by the local characteristic value calculator, 
and the control information set by the control informa- 
tion set unit, and outputting the modified quantization 
scale toward the quantizer. Therefore, the apparatus 
can perform rate control on the basis of the local char- 
acteristics of image, whereby the quality of coded image 
is improved and the precision in the rate control is 
improved. 




Printed by Xerox (UK) Business Services 
2.16.3/3.4 




1 



EP0848 559A2 



2 



Description 

FIELD OF THE INVENTION 

The present invention relates to apparatuses and 
methods for coding image, apparatuses and methods 
for decoding image, coded image recording media, and 
coded image transmitting methods. More particularly, 
the invention relates to image coding employed when a 
digital image is compressed for transmission and 
recording. 

BACKGROUND QF THE INVENTION 

With the development of digital technology in recent 
years, the transfer rate for digitizing an image and out- 
putting it as digital image data reaches several hun- 
dreds of megabits/sec - several gigabits/sec. When 
transmitting or recording the digital image data, the 
transmission is restricted by the communication cost 
and the recording is restricted by the recording capacity. 
So, there are proposed a coding technique of com- 
pressing digital image data to obtain coded image data 
and a decoding technique of decompressing the coded 
image data to obtain the original image, whereby com- 
pressed digital data are transmitted and recorded. 

Figure 8 is a diagram for explaining the compres- 
sive coding and the decompressive decoding. As shown 
in figure 8, generally, image data, that is. an array of dig- 
itized pixels, is divided into blocks each having a pre- 
scribed size (8x8 pixels in figure 8). Each pixel has a 
pixel value relating to its color and luminance. In this 
stage, however, the pixel values are in the random state 
, as the original image. When these pixels are subjected 
to transform such as DOT (Discrete Cosine Transform), 
pixels of large pixel values are biased as shown in the 
figure. So, by quantization, each term is arithmetically 
divided by a prescribed number and terms of less con- 
tribution are treated as 0, thereby compressing the 
image data. Thereafter, variable-length code conversion 
is sometimes earned out. As shown in figure 8, when 
. the* coded data is transmitted and received, the coded 
data is restored to the original image in a decoding 
process comprising inverse quantization, i.e., inverse 
arithmetic of the above-mentioned quantization, and 
inverse transform, i.e., inverse arithmetic of the above- 
mentioned transform, whereby an image approximately 
equal to the original image is obtained. 

Further, variable-length coding, such as run-length 
coding, enables further compression of data. For exam- 
ple, in run-length coding, data compression is achieved 
as follows. That is, the number of continuous pixels hav- 
ing the same pixel values is coded as a 2-byte code 
(run) and the pixel value is coded as a 1-byte code 
(length). Hereinafter, a notation like [00] means 1 byte in 
hexadecimal numeral. 

For example, assuming that an array of pixel val- 
ues, [00][00][00][01][01][02][02][02][02][02], is given, 



this is coded as follows. Since three pieces of [00] con- 
tinue from the head of the array. 2-byte data [00][03] 
showing three pieces' and 1 -byte data [00] showing the 
pixel value are given. Subsequently, since two pieces of 

5 [01] continue, 2-byte data [00][02] showing two pieces' 
and 1-byte data [01] showing the pixel value are given. 
Finally, for subsequent five pieces of [02], 2-byte data 
[00][05] showing live pieces' and 1-byte data [02] show- 
ing the pixel value are given. These data are arranged 

W as [00][03][00][00][02][01][00][05][02], resulting in 
coded data compressed by 10%. As the number of con- 
tinuous pixels of the same pixel value increases, the 
compression ratio increases. 

Furthermore, coding is generally carried out on the 

is basis of the spatial or temporal local correlation pos- 
sessed by image, and this coding is called "local cod- 
ing". There are two kinds of local coding processes: 
intra-frame coding that eliminates redundancy accord- 
ing to the spatial correlations of pixels in a frame, and 

20 inter-frame coding that eliminates redundancy accord- 
ing to temporal correlations between different frames. 

Figures 9(a) and 9(b) are diagrams for explaining 
the intra-frame coding and the inter-frame coding, 
respectively. As shown in figure 9(a), in a still picture, 

2$ there is a strong possibility that adjacent pixels will have 
the same or near pixel values. The intra-coding employs 
this correlation for compression, according to the con- 
ception of space frequency. 

On the other hand, as shown in figure 9(b), a mov- 

30 ing picture is digitized and treated as plural pieces of still 
pictures. There is a strong possibility that, among the 
plural still pictures, adjacent still pictures like N-1 and N 
will be identical or similar, and the inter-frame coding is 
carried out on the basis of this fact For example, a drf- 

35 ference between digital image data N-1 and N is 
obtained, and only a portion of N different from N-1 is 
subjected to the subsequent processing, thereby to 
compress the image data. Even in the inter-frame cod- 
ing, the first still picture is processed by the intra-frame 

40 coding. 

In the above-mentioned compressive coding, to 
increase the compression ratio results in degraded 
image quality. So, in order to achieve appropriate com- 
pression, "rate control" for controlling the coded data 

45 generation rate is required. This rate control is per- 
formed by appropriately setting the quantization scale 
according to the input data because the quantization 
scale, which is used for division in the above-mentioned 
quantization process, is directly linked with the informa- 

so tion quantity generated as coded data. 

An image coding apparatus performing such rate 
control according to a prior art (ISO- 
IEC/JIC1/SC29/WG11 N0328) will be described here- 
inafter. 

55 Figure 7 is a block diagram illustrating the image 
coding apparatus. As shown in the figure, the apparatus 
comprises a subtracter 1, an image transformer 2, a 
quantizer 3, a variable-length encoder 4, an inverse 
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quantizer 5, an inverse image transformer 6, an adder 7, 
an image storage unit 8, an activity calculator 22, and a 
quantization scale decision unit 23. 

The subtracter 1 calculates a difference between an 
input image per coding unit and a reference image cre- 
ated from an already coded image, providing an input 
image to be transformed. The image transformer 2 
receives the input image to be transformed, and per- 
forms prescribed transformation to the image, thereby 
generating a transformed image. The quantizer 3 quan- 
tizes the transformed image according to a modified 
quantization scale from the quantization scale decision 
unit 23, thereby generating a transformed and quan- 
tized coefficient. The variable-length encoder 4 receives 
the transformed and quantized coefficient and performs 
variable-length coding, thereby generating a coding 
result to which the modified quantization scale is added. 
Further, the encoder 4 measures the information quan- 
tity of the coding result and outputs it to the quantization 
scale decision unit 23. The inverse quantizer 5 receives 
the transformed and quantized coefficient and the mod- 
ified quantization scale, and generates inversely quan- 
tized image. The inverse image transformer 6 receives 
the inversely quantized image and performs prescribed 
inverse transformation, thereby generating an inversely 
transformed image. The adder 7 adds the reference 
image and the inversely transformed image to generate 
a locally decoded image. The image storage unit 8 
stores the locally decoded image for a prescribed period 
of time, and outputs the reference image. 

The activity calculator 22 calculates an activity and 
an average activity which are used for performing rate 
control with a modified quantization scale. The quanti- 
zation scale decision unit 23 decides a modified quanti- 
zation scale on the basis of the activity and the average 
activity calculated by the activity calculator 22, the infor- 
mation quantity of the coding result output from the var- 
iable-length encoder 4, and a given target bit number. 
The modified quantization scale is input to the quantizer 
3, the inverse quantizer 5, and the variable-length 
encoder 4. 

A description is given of the operation of the image 
coding apparatus shown in figure 7, with respect to [A. 
Coding], [B. Local Decoding], and [C. Rate Control]. 

[A. Coding] 

Initially, an image is divided into plural sub-areas 
according to digitized data of the image, and each sub- 
area image is successively input to the apparatus as an 
input image S100 per coding unit. The input image is 
composed of four luminance signal blocks and two 
color-difference signal blocks, and each block com- 
prises 8x8 pixels. This block set is called a macroblock. 
The image S100 per coding unit (macroblock) is coded 
by the intra-frame coding or the inter-frame coding 
based on a prescribed criterion. In this example, only 
the first macroblock is coded by intra-frame coding, and 



48559A2 4 

subsequent macroblocks are coded by the inter-frame 
coding. 

In a local decoding process described later, a refer- 
ence image S108 is generated using a locally decoded 

5 image S107 stored in the image storage unit 8, and an 
input image S101 to be transformed is generated from 
the image S100 and the reference image S 108 by the 
subtracter 1. The input image S101 is transformed in 
the image transformer 2 to be a transformed image 

io S102. The transformed image S 102 is quantized by the 
quantizer 3 to be a transformed and quantized coeffi- 
cient S1 03. the quantization scale used in the quantiza- 
tion is decided for each coding target (macroblock). An 
initial value set in advance is used at the beginning and, 

is when a modified quantization scale is given by the 
quantization scale decision unit 23, the modified quanti- 
zation scale is used thereafter. 

Further, the variable-length encoder 4 performs 
run-length coding to the transformed and quantized 

20 coefficient S103 in a prescribed order from the towel 
band toward the higher band, and outputs a brtstream 
S104 which is the coding result of the image S100. Fur- 
ther, for rate control, the variable-length encoder 4 
measures the information quantity of the coding result 

25 as bit number b and outputs this toward the quantization 
scale decision unit 23. 

[B. Local Decoding] 

30 As described above, in the inter-frame coding, a dif- 
ference image is obtained using a previously processed 
image as a reference image S108, so that it is neces- 
sary to locally decode the coded data so that the decod- 
ing result can be used as the reference image. 

35 The transformed and quantized coefficient S103 
obtained by the quantizer is also input to the inverse 
quantizer 5. Then, the inverse quantizer 5 performs 
inverse quantization to generate an inversely quantized 
image S105. The inversely quantized image S105 is 

40 inversely transformed by the inverse image transformer 
6 to be an inversely transformed image S106. The 
inversely transformed image S106 is added to the refer- 
ence image by the adder 7, thereby generating a locally 
decoded image S107. The locally decoded image S107 

45 is stored in the image storage unit 8 for a prescribed 
period of time, whereby a reference image S 108 for the 
next input is obtained. 

[C. Rate Control] 

so 

Rate control by modifying the quantization scale is 
carried out as follows. The activity calculator 22 calcu- 
lates an activity act per input image S100, and outputs 
the activity to the quantization scale decision unit 23. To 
55 be specific, the activity is obtained by calculating vari- 
ances of the respective blocks of luminance signal in the 
image S100 and adding 1 to the smallest variance. Fur- 
ther, the activity calculator 22 obtains an average of 
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activities of the input image S100 within the frame, and 
outputs an average activity avg_act toward the quanti- 
zation scale decision unit 23. The average activity 
avg^act input to the quantization scale decision unit 23 
is a value calculated with respect to a frame for which 
coding has just been completed. 

The quantization scale decision unit 23 decides a 
modified quantization scale, according to a target bit 
number Tb of coding result generated in a frame 
obtained by a prescribed method, the bit number b 
obtained as the information quantity of the above-men- 
tioned coding result, the activity act of the image S100. 
and the average activity avg_act. 

The quantization scale decision unit 23 decides the 
modified quantization scale in the following manner. 
The quantization scale decision unit 23 retains parame- 
ters of buffer fullness dj (quantity of data in a virtual 
buffer) corresponding to the respective coding modes 
for coding the original image, i.e., intra-frame coding, 
inter-frame coding using forward prediction, and inter- 
frame coding using bidirectional prediction, and it per- 
forms rate control based on the buffer fullness dj. The 
buffer fullness dj is updated to a value obtained in for- 
mula (1) when coding of the image $100 has been com- 
pleted. 



dj =d0 + b 



Tb 
MBn 



(D 



where dO is a value of buffer fullness dj when process- 
ing of a previous macroblock has just been completed, 
and MBn is the number of macroblocks constituting the 
frame of the original image. 

Using the buffer fullness dj, a quantization scale qj 
is obtained in formula (2). 



Ql 



of/x31 
r 



(2) 



where r is the reaction parameter which is represented 
-; by formula (3). In formula (3), biL&te is the target bit 
number of coding result per second, and picture_rate is 
the number of input original images per second. 



{bit_rate) 
{picture_rate) 



(3) 



Further, the quantization scale qj is subjected to 
modulation in formula (4), thereby generating a modi- 
fied quantization scale mq. The modified quantization 
scale mq is input to the quantizer 3. 



mq = qj x 



2xact+avg__act 
act+2*avg_act 



(4) 



On the basis of the modified quantization scale mq 
obtained in formula (4), the quantizer 3 performs quan- 
tization. In addition, the modified quantization scale mq 
is input to the inverse quantizer 5 and to the variable- 

s length encoder 4. In the inverse quantizer 5, it is used 
for inverse quantization. In the variable-length encoder 
4, it is coded and incorporated in the coding result. That 
is, it is incorporated as information to be used for 
inverse quantization when the coding result is subjected 

w to decoding. 

As described above, in the image coding apparatus 
according to the prior art, the quantizer 3 modifies the 
quantization scale for quantization by feedback control, 
thereby to perform rate control. Therefore, the data 

is quantity of the coding result can be approximated to the 
target data quantity set in advance. 

However, the image coding apparatus has the fol- 
lowing drawbacks. 

In the image coding apparatus, rate control is car- 

20 ried out for the purpose of making the bit number per 
coding unit (macroblock) uniform by adjusting it to the 
target bit number. That is, in formula (1), an error 
between "the bit number b of coding result output for 
each macroblock" and "the value obtained by equally 

2S dividing the target bit number Tb with the number of 
macroblocks" is accumulated and fed back, thereby to 
realize rate control. In this case, appropriate rate control 
is possible as long as the information quantity of the 
input image to be transformed (S101 in figure 7) is uni- 

30 form over the original image. However, when the infor- 
mation quantity of the input image is considerably 
biased, rate control does not function satisfactorily. Fur- 
ther, because of the rate control, local characteristics of 
the original image cannot be reflected, resulting in 

35 degraded quality of coded image. 

SUMMARY QF THE INVENTION 

It is an object of the present Invention to provide an 
40 image coding apparatus that reflects local characteris- 
tics of an original image, and that improves precision in 
rate control and image quality of coding result. 

It is another object of the present invention to pro- 
vide an image coding method that reflects local charac- 
45 teristics of an original image, and that improves 
precision in rate control and image quality of coding 
result. 

Other objects and advantages of the invention will 
become apparent from the detailed description that fol- 

so lows. The detailed description and specific embodi- 
ments described are provided only for illustration since 
various additions and modifications within the scope of 
the invention will be apparent to those of skill in the art 
from the detailed description. 

55 According to a first aspect of the invention, there is 
■ provided an image coding apparatus that receives an 
input image per coding unit, which is obtained by divid- 
ing an original digital image in coding units, and codes 
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the input image to obtain coded data, and the apparatus 
comprises subtraction means for providing a difference 
image between the input image per coding unit and a 
reference image generated from a coded image which 
has already been coded; image transform means for 5 
receiving, as an input image to be transformed, one of 
the input image per coding unit and the difference 
image, and performing a prescribed transformation 
process to the input image to be transformed, thereby to 
obtain a transformed image; quantization means for to 
quantizing the transformed image by one of a pre- 
scribed' quantization scale and a modified quantization 
scale which is given from a quantization scale decision 
means described later, thereby to obtain transformed 
and quantized coefficients; coding means for coding the 15 
transformed and quantized coefficients to obtain coded 
data, and outputting tfye coded data; local characteristic 
value calculation means for obtaining a complexity 
index value from the input image to be transformed and, 
using the complexity index value, calculating local char* 20 
acteristic values which are used for modification of the 
quantization scale; control information set means for 
setting control information which is used for modification 
of the quantization scale; and quantization scale deci- 
sion means for modifying the quantization scale using 2 s 
the quantity of the coded data output from the coding 
means, the local characteristic values calculated by the 
local characteristic value calculation means, and the 
control information set by the control information set 
means, and outputting the modified quantization scale 30 
toward the quantization means. In this structure, the 
local characteristic value calculation means obtains the 
complexity index value on the basis of the input image 
to be transformed, which image is a difference between 
the Input image per coding unit and the reference image 35 
and, on the basis of the complexity index value, it calcu- 
lates the local characteristic values to be used for mod- 
ification of the quantization scale. The control 
information set means sets the control information to be 
used for rate control, and the quantization scale deci- 40 
sion means modifies the quantization scale in the quan- 
tization process using the local characteristic values 
and the control information, whereby rate control is car- 
ried out. 

According to a second aspect of the invention, in 45 
the above-mentioned image coding apparatus, the local 
characteristic value calculation means is a parameter 
calculation means which provides, as the local charac- 
teristic values, quantization scale modification parame- 
ters calculated on the basis of the complexity index so 
values, an image significance decision result obtained 
as a result of comparison of the complexity index value 
of each input image to be transformed with a prescribed 
value, and a significant image area ratio showing the 
number of the input images to be transformed whose ss 
image significance decision results are "significant", 
and the parameter calculation means outputs the quan- 
tization scale modification parameters, the image signif- 
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icance decision resulCand the significant image area 
ratio toward the quantization scale decision means; the 
control information set means sets a target value of the 
quantity of the coded data as a target data quantity, and 
outputs the target data quantity toward the quantization 
scale decision means; and the quantization scale deci- 
sion means decides the modified quantization scale, on 
the basis of the target data quantity output from the con- 
trol information set means, and the quantization scale 
parameters, the significant image area ratio and the 
image significance decision result which are output from 
the parameter calculation means. In this structure, rate 
control is carried out by modifying the quantization scale 
by the quantization scale decision means using the 
quantization scale modification parameters, the image 
significance decision result, and the significant image 
area ratio which are obtained by the parameter calcula- 
tion means, and the target data quantity set by the con- 
trol information set means. 

According to a third aspect of the invention, the 
above-mentioned image coding apparatus further com- 
prises control information storage means for storing 
control information used for modification of the quanti- 
zation scale. In the apparatus, the local characteristic 
value calculation means is a complexity calculation 
means which provides a complexity mean value being 
an average of the complexity index values, an image 
significance decision result being a result of comparison 
of the complexity index value of each input image to be 
transformed with a prescribed value, and a significant 
image area ratio showing the number of the input 
images to be transformed whose image significance 
decision results are "significant", and the complexity 
calculation means outputs the complexity mean value 
and the significant image area ratio toward the control 
information storage means as control information while 
outputs the complexity index values toward the quanti- 
zation scale decision means; the control information set 
means sets a target value of the quantity of the coded 
data as a target data quantity, sets a complexity mean 
value and a significant image area ratio on the basis of 
the control information stored in the control information 
storage means, and outputs the target data quantity, the 
complexity mean value, and the significant image area 
ratio toward the quantization scale decision means; and 
the quantization scale decision means decides the 
modified quantization scale, on the basts of quantization 
scale modification parameters calculated from the com- 
plexity index values, and the complexity mean value, the 
significant image area ratio and the target data quantity 
which are output from the control information set 
means. In this structure, rate control is carried out by 
modifying the quantization scale by the quantization 
scale decision means using the complexity index values 
obtained by the complexity calculation means, the com- 
plexity mean value and the significant image area ratio 
which are set by the control information set means on 
the basis of the stored content of the control information 
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storage means, and the target data quantity set by the 
control information set means. 

According to a fourth aspect of the invention, in the 
above-mentioned image coding apparatus, the local 
characteristic value calculation means is a parameter 
calculation means which provides a complexity mean 
value being an average of the complexity index values 
with respect to the original image, modulation parame- 
ters obtained from the statistical characteristics of the 
complexity index values, and weighting parameters 
obtained from the complexity index values using a pre- 
scribed function, calculates quantization scale modifica- 
tion parameters from the complexity index values, the 
complexity index mean value, and the modulation 
parameters, and outputs the weighting parameters and 
the quantization scale modification parameters toward 
the quantization scale decision means; the control infor- 
mation set means sets a target value of the quantity of 
the coded data as a target data quantity, sets quantiza- 
tion characteristic information showing quantization 
characteristics for decision of the quantization scale, 
and outputs the target data quantity and the quantiza- 
tion characteristic information toward the quantization 
scale decision means; and the quantization scale deci- 
sion means decides the modified quantization scale, on 
the basis of the quantization scale modification parame- 
ters output from the parameter calculation means, and 
the quantization characteristic information and the tar- 
get data quantity which are output from the control infor- 
mation set means. In this structure, rate control is 
carried out by modifying the quantization scale by the 
quantization scale decision means using the weighting 
parameters and the quantization scale modification 
parameters which are obtained by the parameter calcu- 
lation means, and the target data quantity and the quan- 
tization characteristic information which are set by the 
control information set means. 

According to a fifth aspect of the invention, the 
above-mentioned image coding apparatus further com- 
prises control information storage means for storing 
control information used for modification of the quanti- 
zation scale. In the apparatus, the local characteristic 
^ value calculation means is a complexity calculation 
means which outputs the complexity index values as the 
control information to the control information storage 
means; the control information set means obtains a 
complexity mean value as an average of the complexity 
index values with respect to the original image, and 
modulation parameters from the statistical characteris- 
tics of the complexity index values, on the basis of the 
complexity index values stored in the control information 
storage means, calculates quantization scale modifica- 
tion parameters from the complexity index values, the 
complexity index mean value, and the modulation 
parameters, and obtains weighting parameters from the 
complexity index values using a prescribed function; the 
control information set means sets a target value of the 
quantity of the coded data as a target data quantity, and 



sets quantization characteristic information showing 
characteristics of quantization for decision of the quanti- 
zation scale; the control information set means outputs 
the quantization scale modification parameters, the 

5 weighting parameters, the target data quantity, and the 
quantization characteristic information toward the quan- 
tization scale decision means; and the quantization 
scale decision means decides the modified quantization 
scale, on the basis of the quantization scale modrfica- 

w tion parameters, the weighting parameters, the quanti- 
zation characteristic information, and the target data 
quantity which are output from the control information 
set means. In this structure, rate control is carried out by 
modifying the quantization scale by the quantization 

is scale decision means, using the weighting parameters, 
the quantization scale modification parameters, the 
quantization characteristic information, and the target 
data quantity, which are set by the control information 
set means on the basis of the complexity index values 

20 calculated by the complexity calculation means and 
stored in the control information storage means. 

According to a sixth aspect of the invention, there is 
provided a recording medium containing coded image 
data, wherein the coded image data are coded data out- 

25 put from the above-mentioned image coding apparatus. 
According to a seventh aspect of the invention, 
there is provided an image decoding apparatus for 
decoding coded image data to obtain an image, and the 
apparatus comprises variable-length decoding means 

30 for decoding coded image data to generate a trans- 
formed and quantized image, reference image informa- 
tion, and a modified quantization scale: inverse 
quantization means for performing inverse quantization 
to the transformed and quantized image using the mod- 

35 Hied quantization scale, thereby to obtain an inversely 
quantized image; inverse 'image transform means for 
performing inverse transform to the inversely quantized 
image, thereby to obtain an inversely transformed 
image; addition means for generating a decoded image 

40 using the inversely transformed image and a reference 
image which is obtained from image storage means 
described later; and image storage means for storing 
the decoded image for a prescribed period of time, gen- 
erating a reference image from the stored decoded 

45 image and the reference image inforrtiation output from 
the variable-length decoding means, and outputting the 
reference image to the addition means; wherein the 
coded data output from the above-mentioned image 
coding apparatus is processed as the coded image 

so data. 

According to an eighth aspect of the invention, 
there is provided an image coding method wherein an 
input image per coding unit, which is obtained by divid- 
ing an original digital image in coding units, is coded to 
55 obtain coded data, and the method comprises subtrac- 
tion step of providing a difference image between the 
input image per coding unit and a reference image gen- 
erated from a coded image which has already been 
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coded; image transform step of receiving, as an input 
image to be transformed, one of the input image per 
coding unit and the difference image, and performing a 
prescribed transformation process to the input image to 
be transformed, thereby to obtain a transformed image; 5 
quantization step of quantizing the transformed image 
by one of a prescribed quantization scale and a modi- 
fied quantization scale which is decided in a quantiza- 
tion scale decision step described later, thereby to 
obtain transformed and quantized coefficients; coding ?0 
step of coding the transformed and quantized coeffi- 
cients to generate coded data; local characteristic value 
calculation step of obtaining a complexity index value 
from the input image to be transformed and, using the 
complexity index value, calculating local characteristic is 
values which are used for modification of the quantiza- 
tion scale; control information set step of setting control 
information which is used for modification of the quanti- 
zation scale; and quantization scale decision step of 
modifying the quantization scale using the quantity of 20 
the coded data generated in the coding step, the local 
characteristic values calculated in the local characteris- 
tic value calculation step, and the control information set 
in the control information set step, thereby to decide a 
modified quantization scale. In this method, in the local 25 
characteristic value calculation, step, the complexity 
index value is obtained on the basis of the input image 
to be transformed, which image is a difference between 
the input image per coding unit and the reference image 
and, on the basis of the complexity index value, the local 30 
characteristic values to be used for modification of the 
quantization scale are calculated. In the control informa- 
tion set step, the control information to be used for rate 
control is set and, in the quantization scale decision 
step, the quantization scale is modified using the local 35 
characteristic values and the control information, 
whereby rate control is carried out. 

According to a ninth aspect of the invention, in the 
above-mentioned image coding method, the local char- 
acteristic value calculation step is a parameter calcula- 40 
tion step in which quantization scale modification 
parameters are calculated on the basis of the complex- 
ity index values, an image significance decision result is 
obtained as a result of comparison of the complexity 
index value of each input image to be transformed with 45 
a prescribed value, and a significant image area ratio is 
obtained, which ratio shows the number of the input 
images to be transformed whose image significance 
decision results are "significant"; in the control informa- 
tion set step, a target value of the quantity of the coded so 
data is set as a target data quantity; and in the quantiza- 
tion scale decision step, the modified quantization scale 
is decided on the basis of the target data quantity set in 
the control information set step, and the quantization 
scale parameters, the significant image area ratio and ss 
the image significance decision result which are calcu- 
lated in the parameter calculation step. In this method, 
rate control is carried out by modifying the quantization 



tizaWscal< 



scale in the quantiz£^Pscale decision step using the 
quantization scale modification parameters, the image 
significance decision result, and the significant image 
area ratio which are obtained in the parameter calcula- 
tion step, and the target data quantity set in the control 
information set step. 

According to a tenth aspect of the invention, in the 
above-mentioned image coding method, the local char- 
acteristic value calculation step is a complexity calcula- 
tion step in which a complexity mean value is obtained 
as an average of the complexity index values, an image 
significance decision result is obtained as a result of 
comparison of the complexity index value of each input 
image to be transformed with a prescribed value, and a 
significant image area ratio is obtained, which ratio 
shows the number of the input images to be trans- 
formed whose image significance decision results are 
"significant"; in the control information set step, a target 
value of the quantity of the coded data is set as a target 
data quantity, and a complexity mean value and a signify 
icant image area ratio are set on the basis of control 
information including the complexity mean value and 
the significant image area ratio; and in the quantization 
scale decision step, the modified quantization scale is 
decided on the basis of quantization scale modification 
parameters calculated from the complexity index val- 
ues, and the complexity mean value, the significant 
image area ratio and the target data quantity which are 
set in the control information set step. In this method, 
rate control is carried out by modifying the quantization 
scale in the quantization scale decision step using the 
complexity index values obtained in the complexity cal- 
culation step, the complexity mean value and the signif- 
icant image area ratio which are set in the control 
information set step, and the target data quantity set in 
the control information set step. 

According to an eleventh aspect of the invention, in 
the above-mentioned image coding method, the local 
characteristic value calculation step is a parameter cal- 
culation step in which a complexity mean value is 
obtained as an average of the complexity index values 
with respect to the original image, modulation parame- 
ters are obtained from the statistical characteristics of 
the complexity index values, weighting parameters are 
obtained from the complexity index values using a pre- 
scribed function, quantization scale modification param- 
eters are calculated using the complexity index values, 
the complexity index mean value, and the modulation 
parameters, and the weighting parameters and the 
quantization scale modification parameters are gener- 
ated so that these parameters can be used in the quan- 
tization scale decision step; in the control information 
set step, a target value of the quantity of the coded data 
is set as a target data quantity, quantization characteris- 
tic information showing quantization characteristics for 
decision of the quantization scale is set, and the target 
data quantity and the quantization characteristic infor- 
mation are output so that these can be used in the 
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quantization scale decision step; and in the quantization 
scale decision step, the modified quantization scale is 
decided on the basis of the quantization scale modifica- 
tion parameters calculated in the parameter calculation 
step, and the quantization characteristic information 
and the target data quantity which are set in the control 
information set step. In this method, rate control is car- 
ried out by modifying the quantization scale in the quan- 
tization scale decision step using the weighting 
parameters and the quantization scale modification 
parameters which are obtained in the parameter calcu- 
lation step, and the target data quantity and the quanti- 
zation characteristic information which are set in the 
control information set step. 

According to a twelfth aspect of the invention, in the 
above-mentioned image coding method, in the control 
information set step, on the basis of the complexity 
index values being the control information, a complexity 
mean value is obtained as an average of the complexity 
index values with respect to the original image, modula- 
tion parameters are obtained from the statistical charac- 
teristics of the complexity index values, quantization 
scale modification parameters are calculated using the 
complexity index values, the complexity mean value, 
and the modulation parameters, weighting parameters 
are obtained from the complexity index values using a 
prescribed function, a target value of the quantity of the 
coded data is set as a target data quantity, and quanti- 
zation characteristic information showing characteris- 
tics of quantization for decision of the quantization scale 
is set; and in the quantization scale decision step, the 
modified quantization scale is decided on the basis of 
the quantization scale modification parameters, the 
weighting parameters, the quantization characteristic 
information, and the target data quantity which are set in 
the 'control information set step. In this method, rate 
control is carried out by modifying the quantization scale 
in the quantization scale decision means, using the 
weighting parameters, the quantization scale modifica- 
tion parameters, the quantization characteristic informa- 
tion, and the target data quantity, which are set in the 
control information set step, on the basis of the com- 
plexity index values. 

According to a thirteenth aspect of the invention, 
there is provided an image decoding method for decod- 
ing coded image data to obtain an image, and the 
method comprises variable-length decoding step of 
decoding coded image data to generate a transformed 
and quantized image, reference image information, and 
a modified quantization scale; inverse quantization step 
of performing inverse quantization to the transformed 
and quantized image using the modified quantization 
scale, thereby to obtain an inversely quantized image; 
inverse image transform step of performing inverse 
transform to the inversely quantized image, thereby to 
obtain an inversely transformed image; addition step of 
generating a decoded image using the inversely trans- 
formed image and a reference image which is gener- 



ated in an image storage step described later; and 
image storage step of storing the decoded image for a 
prescribed period of time, and generating a reference 
image from the stored decoded image and the refer- 

5 ence image information generated in the variable-length 
decoding step; wherein the coded data obtained by the 
above-mentioned image coding method is processed 
as the coded image data. 

According to a fourteenth aspect of the invention, 

10 there is provided a method for transmitting coded image 
data, wherein the coded image data are coded data 
processed in the above-mentioned image coding 
method. 

According to a fifteenth aspect of -the invention, 

is there is provided a recording medium containing an 
image coding program for coding an input image per 
coding unit, which image is obtained by dividing an orig- 
inal digital image in coding units, thereby to obtain 
coded data, and the image coding program comprises 

20 subtraction step of providing a difference image 
between the input image per coding unit and a refer- 
ence image generated from a coded image which has 
already been coded; image transform step of receiving, 
as an input image to be transformed, one of the input 

25 image per coding unit and the difference image, and 
performing a prescribed transformation process to the 
input image to be transformed, thereby to obtain a 
transformed image; quantization step of quantizing the 
transformed image by one of a prescribed quantization 

30 scale and a modified quantization scale which is 
decided in a quantization scale decision step described 
later, thereby to obtain transformed and quantized coef- 
ficients; coding step of coding the transformed and 
quantized coefficients to generate coded data; local 

35 characteristic value calculation step of obtaining a com- 
plexity index value from the input image to be trans- 
formed and, using the complexity index value, 
calculating local characteristic values which are used for 
modification of the quantization scale; control informa- 

40 tion set step of setting control information which is used 
for modification of the quantization scale; and quantiza- 
tion scale decision step of modifying the quantization 
scale using the quantity of the coded data generated in 
the coding-step, the local characteristic values calcu- 

45 lated in the local characteristic value calculation step, 
and the control information set in the control information 
set step, thereby to decide a modified quantization 
scale. By executing the image coding program in a com- 
puter system or the like, rate control is carried out as fol- 

so lows. In the local characteristic value calculation step, 
the complexity index value is obtained on the basis of 
the input image to be transformed, which image is a dif- 
ference between the input image per coding unit and 
the reference image and, on the basis of the complexity 

55 index value, the local characteristic values to be used 
for modification of the quantization scale are calculated. 
In the control information set step, the control informa- 
tion to be used for rate control is set and, in the quanti- 
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zation scale decisr^ptep, the quantization scale is 
modified using the local characteristic values and the 
control information, whereby rate control is carried out. 

According to a sixteenth aspect of the invention, in 
the above-mentioned recording medium, the local char- s 
acteristic value calculation step of the image coding pro- 
gram is a parameter calculation step in which 
quantization scale modification parameters are calcu- 
lated on the basis of the complexity index values, an 
image significance decision result is obtained as a io 
result of comparison of the complexity index value of 
each input image to be transformed with a prescribed 
value, and a significant image area ratio is obtained, 
which ratio shows the number of the input images to be 
transformed whose image significance decision results is 
are "significant"; in the control information set step of 
the image coding program, a target value of the quantity 
of the coded data is set as a target data quantity; and in 
the quantization scale decision step of the image coding 
program, the modified quantization scale is decided on 20 
the basis of the target data quantity set in the control 
information set step, and the quantization scale param- 
eters, the significant image area ratio and the image sig- 
nificance decision result which are calculated in the 
parameter calculation step. By executing the image cod- ss 
ing program in a computer system or the like, rate con- 
trol is carried out by modifying the quantization scale in 
the quantization scale decision step using the quantiza- 
tion scale modification parameters, the image signifi- 
cance decision result, and the significant image area 30 
ratio which are obtained in the parameter calculation 
step, and the target data quantity set in the control infor- 
mation set step. 

According to a seventeenth aspect of the invention, 
in the above-mentioned recording medium, the local 35 
characteristic value calculation step of the image coding 
program is a complexity calculation step in which a com- 
plexity mean value is obtained as an average of the 
complexity index values, an image significance decision 
result is obtained as a result of comparison of the com- <o 
plexity index value of each input image to be trans- 
formed with a prescribed value, and a significant image 
area ratio is obtained, which ratio shows the number of 
the input images to be transformed whose image signif- 
icance decision results are "significant"; in the control 45 
information set step of the image coding program, a tar- 
get value of the quantity of the coded data is set as a 
target data quantity, and a complexity mean value and a 
significant image area ratio are set on the basis of con- 
trol information including the complexity mean value so 
and the significant image area ratio; and in the quantiza- 
tion scale decision step of the image coding program, a 
modified quantization scale is decided on the basis of 
quantization scale modification parameters calculated 
from the complexity index values, and the complexity ss 
mean value, the significant image area ratio and the tar- 
get data quantity which are set in the control information 
set step. By executing the image coding program in a 
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computer system o^^nke; rate control is carried out 
by modifying the quantization scale in the quantization 
scale decision step using the complexity index values 
obtained in the complexity calculation step, the com- 
plexity mean value and the significant image area ratio 
which are set in the control information set step, and the 
target data quantity set in the control information set 
step. 

According to an eighteenth aspect of the invention, 
in the above-mentioned recording medium, the local 
characteristic value calculation step of the image coding 
program is a parameter calculation step in which a com- 
plexity mean value is obtained as an average of the 
complexity index values with respect to the original 
image, modulation parameters are obtained from the 
statistical characteristics of the complexity index values, 
weighting parameters are obtained from the complexity 
index values using a prescribed function, quantization 
scale modification parameters are calculated using the 
complexity index values, the complexity index mean 
value, and the modulation parameters, and the weight- 
ing parameters and the quantization scale modification 
parameters are generated so that these parameters can 
be used in the quantization scale decision step; in the 
control information set step of the image coding pro- 
gram, a target value of the quantity of the coded data is 
set as a target data quantity, quantization characteristic 
information showing quantization characteristics for 
decision of the quantization scale is set, and the target 
data quantity and the quantization characteristic infor- 
mation are output so that these can be used in the 
quantization scale decision step; and in the quantization 
scale decision step of the image coding program, the 
modified quantization scale is decided on the basis of 
the quantization scale modification parameters calcu- 
lated in the parameter calculation step, and the quanti- 
zation characteristic information and the target data 
quantity which are set in the control information set 
step. By executing the image coding program in a com- 
puter system or the like, rate control is carried out by 
modifying the quantization scale in the quantization 
scale decision step using the weighting parameters and 
the quantization scale modification parameters which 
are obtained in the parameter calculation step, and the 
target data quantity and the quantization characteristic 
information which are set in the control information set 
step. 

According to a nineteenth aspect of the invention, in 
the above-mentioned recording medium, in the control 
information set step of the image coding program, on 
the basis of the complexity index values being the con- 
trol Information, a complexity mean value is obtained as 
an average of the complexity index values with respect 
to the original image, modulation parameters are 
obtained from the statistical characteristics of the com- 
plexity index values, quantization scale modification 
parameters are calculated using the complexity index 
values, the complexity mean value, and the modulation 
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parameters, weighting parameters are obtained from 
the complexity index values using a prescribed function, 
a target value of the quantity of the coded data is set as 
a target data quantity, and quantization characteristic 
information showing characteristics of quantization for 
decision of the quantization scale is set; and in the 
quantization scale decision step of the image coding 
program, the modified quantization scale is decided on 
the basis of the quantization scale modification parame- 
ters, the weighting parameters, the quantization charac- 
teristic information, and the target data quantity which 
are set in the control information set step. By executing 
the image coding program in a computer system or the 
like, rate control is carried out by modifying the quanti- 
zation scale in the quantization scale decision means, 
using the weighting parameters, the quantization scale 
modification parameters, the quantization characteristic 
information, and the target data quantity, which are set 
in the control information set step, on the basis of the 
complexity index values. 

According to a twentieth aspect of the invention, 
there is provided a recording medium containing an 
image decoding program for decoding coded image 
data to obtain an image, and the image decoding pro- 
gram comprises variable-length decoding step of 
decoding coded image data to generate a transformed 
and quantized image, reference image information, and 
a modified quantization scale; inverse quantization step 
of performing inverse quantization to the transformed 
and quantized image using the modified quantization 
scale, thereby to obtain an inversely quantized image; 
inverse image transform step of performing inverse 
transform to the inversely quantized image, thereby to 
obtain ah inversely transformed image; addition step of 
generating a decoded image using the inversely trans- 
formed image and a reference image which is gener- 
ated in an image storage step described later; and 
image storage step of storing the decoded image for a 
prescribed period of time, and generating a reference 
image from the stored decoded image and the refer- 
ence image information generated in the variable-length 
decoding step; wherein the coded data obtained by the 
■ above-mentioned image coding method is processed 
as the coded image data. By executing the image 
decoding program in a computer system or the tike, 
coded data processed in the above-mentioned image 
coding method is decoded. 

BRIEF Di=$QPIFTIQN QFTHE DRAWINQS 

Figure 1 is a block diagram illustrating an image 
coding apparatus according to a first embodiment of the 
present invention. 

Figure 2 is a block diagram illustrating an image 
coding apparatus according to a second embodiment of 
the present invention. 

Figure 3 is a block diagram illustrating an image 
coding apparatus according to a third embodiment of 



the present invention. 

Figure 4 is a block diagram illustrating an image 
coding apparatus according to a fourth embodiment of 
the present invention. 
5 Figure 5 is a block diagram illustrating an image 
decoding apparatus according to a fifth embodiment of 
the present invention. 

Figure 6 is a block diagram for explaining a coded 
image recording medium and a coded image transmit- 
to ting medium according to a sixth embodiment of the 
present invention. 

Figure 7 is a block diagram illustrating an image 
coding apparatus according to the prior art. 

Figure 8 is a diagram for explaining image coding 
is and decoding. 

Figures 9(a) and 9(b) are diagrams for explaining 
intra-frame coding and inter-frame coding, respectively. 

DETAILED DESCRIPTION QFTHE PREFERRED 
20 EMBODIMENTS 

[Embodiment 1] 

In an image coding apparatus according to a first 

25 embodiment of the invention, when rate control is per- 
formed, modification of quantization scale is carried out 
on the basis of a complexity index value in a difference 
image between an input image per coding unit and a 
reference image. 

30 Rgure 1 is a block diagram illustrating an image 
coding apparatus according to the first embodiment of 
the invention. With reference to figure 1, the apparatus 
comprises a subtracter 1, an image transformer 2, a 
quantizer 3, a variable-length encoder 4, an inverse 

35 quantizer 5, an inverse image transformer 6, an adder 7, 
an image storage unit 8, i.a parameter calculator 9, a 
quantization scale decision unit 10, and a control infor- 
mation set unit 51 . 

The parameter calculator 9 obtains a complexity 

40 index value of an input image S101 to be transformed, 
and calculates a quantization scale modification param- 
eter, an image significance decision result, and a signif- 
icant image area ratio, using the complexity index value. 
The result of the calculation is input to the quantization 

45 scale decision unit 10. The quantization scale decision 
unit 10 decides a modified quantization scale on the 
basis of the data quantity of the coding result output 
from the variable-length encoder 4, the quantization 
scale modification parameter output from the parameter 

so calculator 9, the image significance decision result, the 
significant image area ratio, and a target data quantity 
Tp output from the control information set unit 51. The 
modified quantization scale output from the quantization 
scale decision unit 10 is input to the quantizer 3, the 

55 inverse quantizer 5, and the variable-length encoder 4. 
The control information set unit 51 obtains a target 
value of output data quantity of coding result by a pre- 
scribed method, and outputs this value to the quantiza- 
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tion scale decisio^^:10 as the target data quantity 
Tp. The subtracter 1, image transformer 2, quantizer 3, 
variable-length encoder 4, inverse quantizer 5, inverse 
image transformer 6, adder 7, and image storage unit 8 
are identical to those already described for the prior art 
and, therefore, do not require repeated description. 

A description is given of the operation of the image 
coding apparatus so constructed, with respect to image 
coding and rate control. The apparatus according to this 
first embodiment performs [A. Coding], [B. Local Decod- 
ing], and [C. Rate Control], like the prior art apparatus. 
Since [A. Coding] and [B. Local Decoding] according to 
this first embodiment are identical to those already 
described for the prior art. only [C. Rate Control] will be 
described hereinafter. 

[C. Rate Control] 

While the prior art apparatus employs an activity 
obtained from the input image per coding unit (S100) to 
provide a modified quantization scale, the apparatus 
according to this first embodiment employs a complexity 
index value obtained from the input image to be trans- 
formed (S101) which is output from the subtracter 1. 

Initially, the parameter calculator 9 obtains a com- 
plexity index value va per input image S101. The com- 
plexity index value va is the total of variances of the 
respective blocks of luminance signal in the input image 
S101 . Next, the complexity index values va of the origi- 
nal image are averaged to obtain a complexity mean 
value va_mean. Then, a quantization scale modification 
parameter M is obtained by formula (5) using the com- 
plexity index value va and the complexity mean value 
va_mean. 



M 



2xva+va_mean 
'' va+2*va_mean 



(5) 



of the coding res 
encoder 4, according 
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from the variable-length 
'formulae (6a) and (6b). 



0(7) = 0(y-1) + Gm 'M§a* Tp 



(case of significant image area) 
10 D(J) = oy-1) 



(6a) 



(6b) 



(case of insignificant image area) 
where Dj is the buffer fullness used for coding of the j-th 
input image per coding unit, Gm is the quantity of coded 

is data output from the variable-length encoder 4, and 
MBa is a value obtained from the significant image area 
ratio S202 output from the parameter calculator 9, and 
this value shows the significant image area ratio of a 
frame for which coding has just been completed. ,. 

20 Using the buffer fullness DfJ) obtained in formula 
(6a) or (6b) and the reaction parameter r obtained in the 
same manner as in the prior art, a quantization scale ctf 
is obtained in formula (7). 



r 



(7) 



Further, the quantization scale qj is modified in for- 
30 mula (8) using the quantization scale modification 
parameter M, providing a modified quantization scale 
mq. The modified quantization scale mq is input to the 
quantization unit 3. 



mq - M x qj 



(8) 



Further, the parameter calculator 9 compares the 40 
complexity index value va obtained for each input image 
S101 with a prescribed value. When the complexity 
index value va is larger than the prescribed value, the 
calculator 9 decides that the input image is significant. 
When the complexity index value va is smaller than the 45 
prescribed value, the calculator 9 decides that the input 
image is insignificant. As the result of the decision, an 
image significance decision result S201 showing "signif- 
icant" or Insignificant" is obtained. Further, a significant 
image area ratio S202 is obtained as the number of so 
input images which are decided as significant images. 
The parameter calculator 9 outputs the quantization 
scale modification parameter M, the image significance 
decision result S201 showing "significant" or "insignifi- 
cant", and the significant image area ratio S202. toward ss 
the quantization scale decision unit 10. 

The quantization scale decision unit 10 performs 
feedback to rate control using information quantity Gm 



As described above, in this first embodiment, rate 
control tor the quantity of coded data is performed by 
modifying the quantization scale used by the quantizer 
3. 

According to the first embodiment of the invention, 
the image coding apparatus is provided with the param- 
eter calculator 9, and a complexity index value which is 
the total of variances of the respective blocks is 
obtained for each input image S101 which is a differ- 
ence between the input image S100 and the reference 
image S108, and the complexity index value is used for 
modification of the quantization scale for rate control. In 
contrast with the prior art method using an activity of a 
block having the smallest variance in the input image 
S100, the apparatus according to the first embodiment 
enables rate control adaptive to the local characteristics 
of the image per coding unit Therefore, as compared 
with the prior art apparatus, with similar hardware struc- 
ture and equal processing time, the quality of coded 
image is improved and the precision of rate control is 
improved. 
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[Embodiment 2] 

In an image coding apparatus according to a sec- 
ond embodiment of the invention, when performing rate 
control by modifying the quantization scale according to s 
the complexity index value, some of characteristic val- 
ues used for the rate control are obtained, not from the 
previously coded frame, but from the frame being the 
coding target, i.e., currently being processed. 

Figure 2 is a block diagram illustrating an. image to 
coding apparatus according to a second embodiment of 
the invention. With reference to figure 2, the apparatus 
comprises a subtracter 1, an image transformer 2, a 
quantizer 3, a variable-length encoder 4, an inverse 
quantizer 5, an inverse image transformer 6, an adder 7, is 
an image storage unit 8. a complexity calculator 11, a 
quantization scale decision unit 12, a control informa- 
tion set unit 53, and a control information storage unit 
52. 

The complexity calculator 1 1 obtains a complexity 20 
index value from an input image S101 to be trans- 
formed, and obtains a complexity mean value and a sig- 
nificant image area ratio from the complexity index 
value. The control information storage unit 52 stores 
control information used for modifying the quantization 25 
scale. The control information set unit 53 sets a target 
data quantity as described for the first embodiment, and 
sets the complexity mean value and the significant 
image area ratio according to the information stored in 
the information storage unit 52, and outputs these val- 30 
ues toward the quantization scale decision unit 12. The 
quantization scale decision unit 12 obtains a quantiza- 
tion scale modification parameter and an image signifi- 
cance decision result, from the complexity index value 
output from the complexity calculator 1 1 . and the com- 35 
plexrty mean value and the significant image area ratio 
output from the control information set unit 53, and uses 
these for deciding a modified quantization scale. The 
subtracter 1, image transformer 2, quantizer 3, variable- 
length encoder 4, inverse quantizer 5, inverse image 40 
transformer 6, adder 7. and image storage unit 8 are 
identical to those already described for the prior art and, 
therefore, do not require repeated description. 

A description is given of the operation of the image 
coding apparatus so constructed, with respect to image 45 
coding and rate control. The apparatus according to this 
second embodiment performs [A. Coding], [B. Local 
Decoding], and [C. Rate Control], like the prior art appa- 
ratus. Since [A. Coding] and [B. Local Decoding] 
according to this second embodiment are identical to so 
those already described for the prior art, only [C. Rate 
Control] will be described hereinafter. 

[C. Rate Control] 

55 

In the apparatus according to the first embodiment, 
the parameter calculator 9 obtains the complexity index 
value of the input image S101 to be transformed and, on 



the basis of the complexity index value, the calculator 9 
obtains the quantization scale modification parameter, 
the image significance decision result, and the signifi- 
cant image area ratio and outputs these to the quantiza- 
tion scale decision unit 10. In contrast with the first 
embodiment, in the apparatus according to this second 
embodiment, the complexity calculator 11 obtains the 
complexity index value first and the complexity, mean 
value and the significant image area ratio afterwards, 
and the complexity mean value and the significant 
image area ratio are output to the control information 
storage unit 52 and stored therein while only the com- 
plexity index value S203 is output to the quantization 
scale decision unit 12. 

The control information set unit 53 outputs a target 
data quantity Tp, which is a target value of output data 
quantity of the coding result, towards the quantization 
scale decision unit 10. Further, receiving control infor- 
mation relating to the complexity mean value and the 
significant image area ratio from the control information 
storage unit 52, the control information set unit 53 out- 
puts the complexity mean value and the significant 
image area ratio, as control information, toward the 
quantization scale decision unit 1 2. 

The quantization scale decision unit 12 obtains a 
quantization scale modification parameter and an 
image significance decision result, on the basis of the 
complexity index value S203 from the complexity calcu- 
lator 1 1 , and the complexity mean value and the signifi- 
cant image area ratio from the control information set 
unit 53. 

Calculations performed by the complexity calculator 
1 1 and the quantization scale decision unit 12 are iden- 
tical to those already described for the first embodiment. 

In order to make the best use of the apparatus 
according to this second embodiment, for example, two- 
pass coding is effective. In the two-pass coding, the first 
pass is carried out in the same manner as described for 
the first embodiment, i.e., values relating to a frame N-1 
for which coding has just been completed are used for 
calculation of the quantization scale modification 
parameter. The complexity mean value and the signifi- 
cant image area ratio obtained at the first pass are 
stored in the control information storage unit 52. In the 
second-pass coding, the control information set unit 53 
obtains a complexity mean value N and a significant 
image area ratio N of a frame N being a coding target 
(hereinafter, referred to as a target frame) using the 
stored control information, and outputs these to the 
quantization scale decision unit 12. 

However, the two-pass coding is not necessarily 
carried out. Even in one-pass coding, rate control can 
be carried out using characteristic values of the target 
frame N by setting the apparatus as follows. That is, a 
high-speed storage unit, such as a memory, is used as 
the control information storage unit 52, and the control 
information set means 53 fetches the stored information 
and sends it to the quantization scale decision unit 12. 
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The quantizer 3 id^Hn an appropriate delay so that it 
can perform quantization using a modified quantization 
scale calculated by the quantization scale decision 
means 12 using the information. 

In the apparatus accoiding to the first embodiment, s 
rate control adaptive to the local characteristics is real- 
ized by using the complexity index value on the basis of 
the input image S101 to be transformed, in place of the 
activity based on the input image S100 used in the prior 
art apparatus. However, with respect to the characteris- 10 
tic values used for calculation to modify the quantization 
scale, those obtained for the previous frame N-1 are 
used, like the prior art apparatus. In contrast with the 
first embodiment, the apparatus according to the sec- 
ond embodiment can perform rate control using the is 
characteristic values obtained for the target frame N 
being processed. In tfris second embodiment, however, 
since the two-pass coding or the one-pass coding with 
a delay is carried out, the processing time and burden 
are increased as compared with the first embodiment. 20 

As described above, according to the second 
embodiment of the invention, the image coding appara- 
tus includes the complexity calculator 1 1 and the control 
information storage unit 52, and the complexity mean 
value and the significant image area ratio output from 25 
the complexity calculator 11 are stored in the control 
information storage unit 52. Further, the control informa- 
tion set unit 53 fetches the information from the storage 
unit 52 and outputs it to the quantization scale decision 
unit 12. Hence, when the quantization scale decision 30 
unit 12 calculates the quantization scale modification 
parameter, the complexity mean value and the signifi- 
cant image area ratio used for the calculation are 
obtained, not from the previously coded frame N-1, but 
from the target frame N being processed, whereby more 35 
appropriate values can be set Therefore, in the image 
coding apparatus according to this second embodi- 
ment, the quality of coded image and the precision in 
rate control are further improved. 

40 

[Embodiment 3] 

In an image coding apparatus according to a third 
embodiment of the invention, when performing rate con- 
trol by modifying the quantization scale according to the 45 
complexity index value, the modification is carried out 
using the statistical characteristics of the complexity 
index value. 

Figure 3 is "a block diagram illustrating an image 
coding apparatus according to a third embodiment of so 
the invention. With reference to figure 3, the apparatus 
comprises a subtracter 1, an image transformer 2, a 
quantizer 3, a variable-length encoder 4, an inverse 
quantizer 5, an inverse image transformer 6, an adder 7, 
an image storage unit 8, a parameter calculator 13, a ss 
quantization scale decision unit 14, and a control infor- 
mation set unit 54. 

The parameter calculator 13 obtains a complexity 



index value from^^Vtput image S101 to be trans- 
formed, and calculates a quantization scale modifica- 
tion parameter M using a complexity mean value 
obtained from the complexity index value and the statis- 
tical characteristics of the complexity index value. Fur- 
ther, the parameter calculator 13 calculates a weighting 
parameter w from the complexity index value, and out- 
puts this parameter w and the quantization scale modi- 
fication parameter M toward the quantization scale 
decision unit 14. The control information set unit 54 sets 
a target data quantity and quantization characteristic 
information, and outputs these to the quantization scale 
decision unit 14. The quantization scale decision unit 14 
decides a modified quantization scale using the weight- 
ing parameter w and the quantization scale modification 
parameter M output from the parameter calculator 13, 
and the quantization characteristic information output 
from the control information set unit 54. The subtracter 
1, image transformer 2, quantizer 3, variable-length 
encoder 4, inverse quantizer 5, inverse image transj 
former 6, adder 7, and image storage unit 8 are identical 
to those already described for the prior art and, there- 
fore, do not require repeated description. 

A description is given of the. operation of the image 
coding apparatus so constructed, with respect to image 
coding and rate control. The apparatus according to this 
third embodiment performs [A. Coding], [B. liocal 
Decoding], and [C. Rate Control], like the prior art appa- 
ratus. Since [A. Coding] and [B. Local Decoding] 
according to this third embodiment are identical to those 
already described for the prior art, only [C. Rate Control] 
will be described hereinafter. 

[C. Rate Control] 

In the apparatus according to the first embodiment, 
the parameter calculator 9 obtains the complexity index 
value of the input image S1 01 to be transformed and, on 
the basis of the complexity index value, the calculator 9 
obtains the quantization scale modification parameter, 
the image significance decision result, and the signifi- 
cant image area ratio and outputs these to the quantiza- 
tion scale decision unit 10. In contrast with the first 
embodiment, in the apparatus according to the third 
embodiment, the parameter calculator 13 uses, for cal- 
culation of the quantization scale modification parame- 
ter, not only the complexity index value and the 
complexity index mean value but also the statistical 
characteristics of the complexity index value. The 
parameter calculator 13 calculates the quantization 
scale modification parameter M as in formula (9). 
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(9) 



where modulation parameter A Is decided on the basis 
of the statistical characteristics of the complexity index 
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value. The modulation parameter A on the basis of the 
statistical characteristics of the complexity index value 
is obtained as follows. Initially, the ratio K of complexity 
index values exceeding the complexity index mean 
value is obtained. Using the ratio K, the modulation 
parameter 4 can be obtained as shown in formula (10). 

A=a*K+b (10) 

where a and b are constants which are set according to 
the coding mode, such as intra-frame coding or inter- 
frame coding. 

In this third embodiment, the parameter calculator 
13 obtains the weighting parameter w according for- 
mula 11a or 11b, and outputs this to the quantization 
scale decision unit 14. 

w = c x va + d 

(va < e) (11a) 

w = 1 

(vase) (11b) 

where c. d and e are constants which are set according 
to the coding mode. 

The quantization scale decision unit 14 obtains the 
buffer fullness according to formula (12), instead of for- 
mula (6a) or (6b) according to the first embodiment. 



That is, in the apparatus according to the first 
embodiment, one of the completely different processes 
shown by formulae (6a) and (6b) is selected according 
to a threshold value, so that an appropriate threshold 
value must be set. In contrast with the first embodiment, 
in the apparatus according to the third embodiment, 
with respect to the weighting parameter obtained by the 
parameter calculator 13, its boundary is smoothed as 
shown in formulae (11a) and (1 1b). Since the quantiza- 
tion scale decision unit 14 receives this weighting 
parameter and performs the calculation of formula (12) 
in place of formula (6a) or (6b), more stable result can 
be obtained also in the vicinity of the boundary value. 

Meanwhile, the control information set unit 54 sets 
the target data quantity Tp as in the first embodiment, 
and sets the quantization characteristic information 
which is used to modify the calculation for obtaining the 
quantization scale from the buffer fullness according to 
formula (7) by the quantization scale decision unit 14, 
and outputs these to the quantization scale decision unit 
14. Although in formula (7) the quantization scale is 
obtained linearly with respect to the buffer fullness, 
actually it is necessary to change the characteristics 



according to the coding rate and the complexity index of 
image. So, to set the conversion characteristics from the 
buffer fullness to the quantization scale by the control 
information set unit 54 enables control well adapted to 

5 the coding rate. 

As described above, according to the third embodi- 
ment of the invention, the image coding apparatus is 
provided with the parameter calculator 13 wherein a 
complexity index value which is the total of variances of 

10 the respective blocks is obtained for each input image 
S101 which is a difference between the input image 
S100 and the reference image S108. When the com- 
plexity index value is used for modification of the quan- 
tization scale for rate control, the quantization scale 

75 modification parameter is calculated with regard to the 
statistical characteristics of the complexity index value. 
Further, the conversion characteristics used when the 
quantization scale decision unit 14 calculates the quan- 
tization scale from the buffer fullness are obtained from 

20 the quantization characteristic information set by the 
control information set unit 54. Therefore, it is possible 
to perform coding well adapted to the characteristics of 
the input image, resulting in improved image quality and 
highly precise rate control. 

25 Although in this third embodiment the modulation 
parameter is obtained according to formula (10), 
another arithmetic expression may be employed as long 
as it satisfies the condition that the modulation parame- 
ter value is decreased when some of complexity index 

30 values within a frame are larger than the others while it 
is increased when the complexity index values are 
smaller than the others. 

Furthermore, although in this third embodiment the 
weighting parameter is obtained according to formula 

3s (11), another arithmetic expression may be employed 
as long as a weighting parameter in proportion to the 
complexity index value can be obtained. 

[Embodiment 4] 

40 

An image coding apparatus according to a fourth 
embodiment of the invention performs modification of 
quantization scale using the statistical characteristics of 
complexity -index values, and it uses characteristic val- 
45 ues obtained not from the previous frame but from the 
frame being the coding target, i.e., being currently proc- 
essed. 

Figure 4 is a block diagram illustrating an image 
coding apparatus according to a fourth embodiment of 

so the invention. With reference to figure 4, the apparatus 
comprises a subtracter 1, an image transformer 2, a 
quantizer 3, a variable-length encoder 4, an inverse 
quantizer 5, an inverse image transformer 6, an adder 7, 
an image storage unit 8, a complexity calculator 15, a 

55 quantization scale decision unit 16, a control informa- 
tion set unit 55, and a control information storage unit 
56. 

The complexity calculator 15 obtains a complexity 
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index value from SW^ut image S101 to be trans- 
formed, and outputs this to the control Information stor- 
age unit 56. The control information storage unit 56 is 
identical to that according to the second embodiment. 
The control information set unit 55 sets a target data 5 
quantity, quantization characteristic information, and a 
weighting parameter and a quantization scale modifica- 
tion parameter on the basis of the information stored in 
the control information storage unit 56. and outputs 
these to the quantization scale decision unit 16. The 10 
quantization scale decision unit 16 uses, for decision of 
a modified quantization scale mq, the weighting param- 
eter, the quantization scale modification parameter, and 
the quantization characteristic information which are 
output from the control information set unit 55. The sub- is 
trader 1, image transformer 2, quantizer 3, variable- 
length encoder 4, inverse quantizer 5, inverse image 
transformer 6, adder 7, and image storage unit 8 are 
identical to those already described for the prior art and, 
therefore, do not require repeated description. 20 

A description is given of the operation of the image 
coding apparatus so constructed, with respect to image 
coding and rate control. The apparatus according to this 
fourth embodiment performs [A, Coding], [B. Local 
Decoding], and fC. Rate Control], like the prior art appa- 25 
ratus. Since [A. Coding] anc* [B. Local Decoding] 
according to this fourth embodiment are identical to 
those already described for the prior art, only [C. Rate 
Control] will be described hereinafter. 

30 

[C. Rate Control] 

The complexity calculator 15 obtains a complexity 
index value from the input image S101 to be trans- 
formed like the parameter calculator 9 according to the 35 
first embodiment, and outputs this to the control infor- 
mation storage unit 56. The control information storage 
unit 56 stores the complexity index value. 

The control information set unit 55 outputs a target 
data quantity 7p, which is a target value of output data <o 
quantity of coding result, to the quantization scale deci- 
sion unit 16 in the same manner as described for the 
first embodiment. In addition, the control information set . 
unit 55 fetches the complexity index value from the con- 
trol information storage unit 56 and, on the basis of the 45 
complexity index value, it obtains a complexity mean 
value and a modulation parameter according to the sta- 
tistical characteristics of the complexity index value, and 
calculates a quantization scale modification parameter 
from the mean value and the modulation parameter, so 
The quantization scale modification parameter is input 
to the quantization scale decision unit 16. Further, the 
control information set unit 55 obtains a weighting 
parameter from the complexity index value in the same 
manner as mentioned for the third embodiment, and ss 
outputs this to the quantization scale decision unit 16. 

Furthermore, the control information set unit 55 
sets the quantization characteristic information which is 
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used for modificatic^fcatculation performed to obtain 
the quantization sca^ffom the buffer fullness by the 
quantization scale decision unit 16 according to formula 
(7), and outputs this information to the quantization 
scale decision unit 16. 

The quantization scale decision unit 16 performs 
the calculation of formula (12), not formulae (6a) and 
(6b), and performs the calculation of formula (7) accord- 
ing to the quantization characteristic information. There- 
after, in the calculation of formula (8), it obtains a 
modified quantization scale using the quantization scale 
modification parameter. 

Also in the apparatus according to this fourth 
embodiment, as described for the second embodiment, 
it is possible to perform modification according to, not 
the characteristic values of the previous frame, but the 
characteristic values of the target frame currently being 
processed, by employing the two-pass coding or the 
one-pass coding with an appropriate delay. , 

As described above, according to the fourth 
embodiment of the invention, the image coding appara- 
tus is provided with the complexity calculator 15 and the 
control information storage unit 56. The complexity cal- 
culator 15 obtains the complexity index value from the 
input image S101 to be transformed, and the control 
information storage unit 56 stores the complexity index 
value. The control information set unit 55 obtains, from 
the stored complexity index value, the complexity mean 
value and the modulation parameter based on the sta- 
tistical characteristics of the complexity index value and, 
according to the mean value and the parameter, the 
control information set unit 55 calculates the quantiza- 
tion scale modification parameter and outputs this to the 
quantization scale decision unit 1,6. Further, the control 
information set unit 55 sets the quantization character- 
istic information which is used for calculation of the 
modified quantization scale by the quantization scale 
decision unit 16, and outputs this to the quantization 
scale decision unit 16. Therefore, coding well adapted 
to characteristics of input image is possible, resulting in 
improved image quality and improved precision in rate 
control. 

Although the first to fourth embodiments are 
described on inter-frame coding, these embodiments 
may be applied to intra-frame coding with the same 
effects as mentioned above. 

Further, the image coding apparatus according to 
any of the first to fourth embodiments is applicable to 
object coding by appropriately processing an image 
before it is input to the coding apparatus. Object coding 
is a coding method in which components constituting an 
image, i.e., background, person, moving object and the 
like, are treated as independent objects, and coding is 
performed object by object. Since coding is carried out 
object by object, edition, such as replacement of a spe- 
cific object, can be performed easily. 

In the image coding apparatus according to any of 
the first to fourth embodiments, as preprocessing, dig- 
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ital image data is stored in a frame memory. At this time, 
a portion (data) of object being the coding target is 
stored as it is while a portion (data) not being the coding 
target is transformed so that its variance becomes 0 and 
stored. Thereby, the stored data can be subjected to 
coding similar to that described above using the image 
coding apparatus according to any of the aforemen- 
tioned embodiments, whereby highly-precise rate con- 
trol is executed, resulting in improved image quality of 
coding result. 

[Embodiment 5] 

Figure 5 is a block diagram illustrating an image 
decoding apparatus according to a fifth embodiment of 
the invention. In the figure, an image coding apparatus 
17 is identical to the image coding apparatus according 
to the first embodiment. An image decoding apparatus 
19 according to this fifth embodiment receives coded 
image data S104 output from the coding apparatus 17, 
and performs decoding of the coded image data S104. 

A variable-length decoder 18 receives the coded 
image data (coding result) S104, and performs variable- 
length decoding to generate a transformed and quan- 
tized image S501, reference image information S502, 
and a modified quantization scale S503. An inverse 
quantizer 5 receives the transformed and quantized 
image and the modified quantization scale, and gener- 
ates an inversely quantized image. An inverse image 
transformer 6 receives the inversely quantized image 
and generates an inversely transformed image by pre- 
scribed inverse transformation. An adder 7 adds a refer- 
ence image and the inversely transformed image to 
generate a locally decoded image. An image storage 
unit 8 stores the locally decoded image for a prescribed 
period of time, and generates the reference image on 
the basis of the reference image information. 

A description is given of the operation of the image 
decoding apparatus so constructed, with respect to 
coded image data processing. 

The coding result S104 output from the image cod- 
ing) apparatus 1 7 is input to the variable-length decoder 
V 18,' and the variable-length decoder 18 generates the 
transformed and quantized image S501, the reference 
image information S502, and the modified quantization 
scale S503. The transformed and quantized image 
S501 and the modified quantization scale S503 are out- 
put toward the inverse quantizer 5 while the reference 
image information S502 is output toward the image stor- 
age unit 8. The inverse quantizer 5 inversely quantizes 
the transformed and quantized image S501 on the basis 
of the modified quantization scale to generate an 
inversely quantized image S504, and outputs this to the 
inverse image transformer 6. The inverse image trans- 
former 6 inversely transforms the inversely quantized 
image S504 to generate an inversely transformed 
image S505, and outputs this to the adder 7. Mean- 
while, the image storage unit 8 generates the reference 



image S506 on the basis of the reference image infor- 
mation S502, and outputs this to the adder 7. The adder 
7 adds the inversely transformed image S505 and the 
reference image S506 to generate a decoded image 

5 S507. The decoded image S507 is output from the 
image decoding apparatus 19 and, on the other hand, it 
is input to the image storage unit 8 and stored for a pre- 
scribed period of time. 

Although the image decoding apparatus 19 

10 decodes coded image data processed in the image cod- 
ing apparatus according to the first embodiment, it can 
decode coded image data processed in any of the cod- 
ing apparatuses according to the second to fourth 
embodiments, in the same manner as described above. 

is As described above, since the image decoding 
apparatus according to the fifth embodiment performs 
decoding on the basis of the modified quantization scale 
generated from the input coded image S104, a high- 
quality decoded image can be obtained. Furthermore, 

20 when the image decoding apparatus according to this 
fifth embodiment is combined with the image coding 
apparatus according to any of the first to fourth embod- 
iment, the quality of the coded image can be checked 
speedily, so that this combination can be employed 

25 when experimentally setting the arithmetical expres- 
sions and coefficients in the image coding apparatus 
according to any of the first to fourth embodiments. 

Although the image decoding apparatus according 
to this fifth embodiment processes coded data obtained 

30 by inter-frame coding in the image coding apparatus, it 
can process coded data processed by intra-frame cod- 
ing with the same effects as mentioned above. 

[Embodiment 6] 

35 

Figure 6 is a block diagram for explaining relations 
between an image recording medium 20, an image 
transmitting medium 21, an image coding apparatus 17, 
and an image decoding apparatus. 

40 The image coding apparatus 17 is identical to the 
image coding apparatus according to the first embodi- 
ment, and capable of performing satisfactory rate con- 
trol and outputting a coded image of improved image 
quality. The image decoding apparatus 19 is identical to 

45 the image decoding apparatus according to the fifth 
embodiment, and capable of providing a decoded 
image of improved image quality by decoding the 
above-mentioned coded image. 

The image recording medium 20 according to this 

so sixth embodiment is implemented by a magnetic record- 
ing medium, such as compact disk, optical disk, optical 
magnetic disk, or hard disk, and it can retain coded 
image data obtained by the image coding apparatus 17 
for an arbitrary period of time. A high quality decoded 

55 image can be obtained by reading and decoding the 
recorded data from the medium 20 at an arbitrary time 
in an arbitrary place. 

The image transmitting medium 21 according to 
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this sixth embodiment is implemented by network, 
cable, radio communication or the like. Even when 
decoding of coded image data is desired in a distant 
place, the medium 21 can speedily transmit the image 
data to the place, whereby high quality decoded image 
can be obtained. 

As described above, according to the sixth embod- 
iment of the invention, since the coded image obtained 
in the image coding apparatus according to any of the 
first to fourth embodiments is migrated using the record- 
ing medium 20 or the transmitting medium 21, a 
decoded image with improved image quality can be 
obtained even in an independent decoding, apparatus, 
exceeding the temporal and spatial restrictions. 

Claims 

1. An image coding apparatus that receives an input 
image per coding unit, which is obtained By dividing 
an original digital image in coding units, and codes 
the input image to obtain coded data, said appara- 
tus comprising: 



ified quantization s^retbward the quantization 



subtraction means for providing a difference 
image between the input image per coding unit ss 
and a reference image generated from a coded 
image which has already been coded; 
image transform means for receiving, as an 
input image to be transformed, one of the input 
image per coding unit and the difference 30 
image, and performing a prescribed transfor- 
mation process to the input image to be trans- 
formed, thereby to obtain a transformed image; 
quantization means for quantizing the trans- 
formed image by one of a prescribed quantiza- 35 
tion scale and a modified quantization scale 
which is given from a quantization scale deci- 3. 
sion means described later, thereby to obtain 
transformed and quantized coefficients; 
coding means for coding the transformed and 40 
quantized coefficients to obtain coded data, 
and outputting the coded data; 
local characteristic value calculation means for 
obtaining a complexity index value from the 
input image to be transformed and, using the 45 
complexity index value, calculating local char- 
acteristic values which are used for modifica- 
tion of the quantization scale; 
control "information set means for setting con- 
trol information which is used for modification so 
of the quantization scale; and 
quantization scale decision means for modify- 
ing the quantization scale using the quantity of 
the coded data output from the coding means, 
the local characteristic values calculated by the ss 
local characteristic value calculation means, 
and the control information set by the control 
information set means, and outputting the mod- 



2. The image coding apparatus of claim 1 wherein: 

s 

the local characteristic value calculation means 
is a parameter calculation means which pro- 
vides, as the local characteristic values, quanti- 
zation scale modification parameters 
io calculated on the basis of the complexity index 

values, an image significance decision result 
obtained as a result of comparison of the com- 
plexity index value of each input image to be 
transformed with a prescribed value, and a sig- 
is nrficant image area ratio showing the number 

of the input images to be transformed whose 
image significance decision results are "signifi- 
cant", and the parameter calculation means 
outputs the quantization scale modification 
20 parameters, the image significance decision 

result, and the significant image area ratio 
toward the quantization scale decision means; 
the control information set means sets a target 
value of the quantity of the coded data as a tar- 
get data quantity, and outputs the target data 
quantity toward the quantization scale decision 
means; and \ 
the quantization scale decision means decides 
the modified quantization scale, on the basis of 
the target data quantity output from the control 
information set means, and the quantization 
scale parameters, the significant image area 
ratio and the image significance decision result 
which are output from the parameter calcula- 
tion means. 



The image coding apparatus of claim 1 further com- 
prising control information storage means for stor- 
ing control information used for modification of the 
quantization scale, wherein: 

the local characteristic value calculation means 
is a complexity calculation means which pro- 
vides a complexity mean value being an aver- 
age of the complexity index values, an image 
significance decision result being a result of 
comparison of the complexity index value of 
each input image to be transformed with a pre- 
scribed value, and a significant image area 
ratio showing the number of the input images to 
be transformed whose image significance deci- 
sion results are "significant", and the complex- 
ity calculation means outputs the complexity 
mean value and the significant image area ratio 
toward the control information storage means 
as control information while outputs the com- 
plexity index values toward the quantization 
scale decision means; 
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the control information set means sets a target 
value of the quantity of the coded data as a tar- 
get data quantity, sets a complexity mean value 
and a significant image area ratio on the basis 
of the control information stored in the control s 
information storage means, and outputs the 
target data quantity, the complexity mean 
value, and the significant image area ratio 
toward the quantization scale decision means; 
and 10 
the quantization scale decision means decides 
the modified quantization scale, on the basis of 
quantization scale modification parameters cal- 
culated from the complexity index values, and 
the complexity mean value, the significant is 
image area ratio and the target data quantity 
which are output from the control information 
set means. 

The image coding apparatus of claim 1 wherein: 20 

the local characteristic value calculation means 
is a parameter calculation means which pro- 
vides a complexity mean value being an aver- 
age of the complexity index values with respect 2$ 
to the original image, modulation parameters 
obtained from the statistical characteristics of 
the complexity index values, and weighting 
parameters obtained from the complexity index 
values using a prescribed function, calculates 30 
quantization scale modification parameters 
from the complexity index values, the complex- 
ity index mean value, and the modulation 
parameters, and outputs the weighting param- 
eters and the quantization scale modification 35 
parameters toward the quantization scale deci- 
sion means; 

the control information set means sets a target 
value of the quantity of the coded data as a tar- 
get data quantity, sets quantization characteris- 40 
tic information showing quantization 
characteristics for decision of the quantization 
scale, and outputs the target data quantity and 
the quantization characteristic information 
toward the quantization scale decision means; as 
and 

the quantization scale decision means decides 
the modified quantization scale, on the basis of 
the quantization scale modification parameters 
output from the parameter calculation means, so 
and the quantization characteristic information 
and the target data quantity which are output 
from the control information set means. 

The image coding apparatus of claim 1 further com- ss 
prising control information storage means for stor- 
ing control information used for modification of the 
quantization scale, wherein: 



the local characteristic value calculation means 
is a complexity calculation means which out- 
puts the complexity index values as the control 
information to the control information storage 
means; 

the control information set means obtains a 
complexity mean value as an average of the 
complexity index values with respect to the 
original image, and modulation parameters 
from the statistical characteristics of the com- 
plexity index values, on the basis of the com- 
plexity index values stored in the control 
information storage means, calculates quanti- 
zation scale modification parameters from the 
complexity index values, the complexity index 
mean value, and the modulation parameters, 
and obtains weighting parameters from the 
complexity index values using a prescribed 
function; 

the control information set means sets a target 
value of the quantity of the coded data as a tar- 
get data quantity, and sets quantization charac- 
teristic information showing characteristics of 
quantization for decision of the quantization 
scale; 

the control information set means outputs the 
quantization scale modification parameters, 
the weighting parameters, the target data 
quantity, and the quantization characteristic 
information toward the quantization scale deci- 
sion means; and 

the quantization scale decision means decides 
the modified quantization scale, on the basis of 
the quantization scale modification parame- 
ters, the weighting parameters, the quantiza- 
tion characteristic 1 , information, and the target 
data quantity which are output from the control 
information set means. 

6. A recording medium containing coded image data, 
wherein the coded image data are coded data out- 
put from the image coding apparatus according to 
claim 1 . 

7. An image decoding apparatus for decoding coded 
image data to obtain an image, comprising: 

variable-length decoding means for decoding 
coded image data to generate a transformed 
and quantized image, reference image infor- 
mation, and a modified quantization scale; 
inverse quantization means for performing 
inverse quantization to the transformed and 
quantized image using the modified quantiza- 
tion scale, thereby to obtain an inversely quan- 
tized image; 

inverse image transform means for performing 
inverse transform to the inversely quantized 
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image, thereby to obtain an inversely trans- 
formed image; 

addition means for generating a decoded 
image using the inversely transformed image 
and a reference image which is obtained from s 
image storage means described later; and 
image storage means for storing the decoded 
image for a prescribed period of time, generat- 
ing a reference image from the stored decoded 
image and the reference image information 10 
output from the variable-length decoding 
means, and outputting the reference image to 
the addition means; 

wherein the coded data output from the 
image coding apparatus according to claim 1 is 15 
processed as the coded image data. 



An image coding method wherein an input image 
per coding unit, which is obtained by cftviding an 
original digital image in coding units, is coded to 20 
obtain coded data, said method comprising: 

subtraction step of providing a difference image 
between the input image per coding unit and a 
reference image generated from a coded 25 
image which has already been coded; 
image transform step of receiving, as an input 
image to be transformed, one of the input 
image per coding unit and the difference 
Image, and performing a prescribed transfer- 30 
mation process to the input image to be trans- 
formed, thereby to obtain a transformed image; 
quantization step of quantizing the transformed 
image by one of a prescribed quantization 
scale and a modified quantization scale which as 
is decided in a quantization scale decision step 
described later, thereby to obtain transformed 
and quantized coefficients; 
coding step of coding the transformed and 
quantized coefficients to generate coded data; 40 
local characteristic value calculation step of 
obtaining a complexity index value from the 
input image to be transformed and, using the 
complexity index value, calculating local char- 
acteristic values which are used for modifica- 45 
tion of the quantization scale; 
control information set step of setting control 
information which is used for modification of 
the quantization scale; and 
quantization scale decision step of modifying 50 
the quantization scale using the quantity of the 
coded data generated in the coding step, the 
local characteristic values calculated in the 
local characteristic value calculation step, and 
the control information set in the control infor- ss 
mation set step, thereby to decide a modified 
quantization scale. 
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9. The image coding mi 



of claim 8 wherein: 



the local characteristic value calculation step is 
a parameter calculation step in which quantiza- 
tion scale modification parameters are calcu- 
lated on the basis of the complexity index 
values, an image significance decision result is 
obtained as a result of comparison of the com- 
plexity index value of each input image to be 
transformed with a prescribed value, and a sig- 
nificant image area ratio is obtained, which 
ratio shows the number of the input images to 
be transformed whose image significance deci- 
sion results are "significant"; 
in the control information set step, a target 
value of the quantity of the coded data is set as 
a target data quantity; and 
in the quantization scale decision step, the 
modified quantization scale is decided on the 
basis of the target data quantity set in the con> 
trol information set step, and the quantization 
scale parameters, the significant image area 
ratio and the image significance decision result 
which are calculated in the parameter calcula- 
tion step. 

10. The image coding method of claim 8 wherein: \ 

the local characteristic value calculation step is 
a complexity calculation step in which a com- 
plexity mean value is obtained as an average of 
the complexity index values, an image signifi- 
cance decision result is obtained as a result of 
comparison of the complexity index value of 
each input image to be transformed with a pre- 
scribed value, and a significant image area 
ratio is obtained, which ratio shows the number 
of the input images to be transformed whose 
image significance decision results are "signifi- 
cant"; 

in the control information set step, a target 
value of the quantity of the coded data is set as 
a target data quantity, and a complexity mean 
value and a significant image area ratio are set 
on the basis of control information including the 
complexity mean value and the significant 
image area ratio; and 

in the quantization scale decision step, the 
modified quantization scale is decided on the 
basis of quantization scale modification param- 
eters calculated from the complexity index val- 
ues, and the complexity mean value, the 
significant image area ratio and the target data 
quantity which are set in the control information 
set step. 

11. The image coding method of claim 1 wherein: 
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the local characteristic value calculation step is 
a parameter calculation step in which a com- 
plexity mean value is obtained as an average of 
the complexity index values with respect to the 
original image, modulation parameters are 
obtained from the statistical characteristics of 
the complexity index values, weighting parame- 
ters are obtained from the complexity index val- 
ues using a prescribed function, quantization 
scale modification parameters are calculated 
using the complexity index values, the com- 
plexity index mean value, and the modulation 
parameters, and the weighting parameters and 
the quantization scale modification parameters 
are generated so that these parameters can be 
used in the quantization scale decision step; 
in the control information set step, a target 
value of the quantity of the coded data is set as 
a target data quantity, quantization characteris- 
tic information showing quantization character- 
istics for decision of the quantization scale is 
set, and the target data quantity and the quan- 
tization characteristic information are output so 
that these can be used in the quantization 
scale decision step; and 
in the quantization scale decision step, the 
modified quantization scale is decided on the 
basis of the quantization scale modification 
parameters calculated in the parameter calcu- 
lation step, and the quantization characteristic 
information and the target data quantity which 
are set in the control information set step. 

12. The image coding method of claim 8 wherein: 

in the control information set step, on the basts 
of the complexity index values being the control 
information, a complexity mean value is 
obtained as an average of the complexity index 
values with respect to the original image, mod- 
ulation parameters are obtained from the sta- 
t tistical characteristics of the complexity index 
* values, quantization scale modification param- 
eters are calculated using the complexity index 
values, the complexity mean value, and the 
modulation parameters, weighting parameters 
are obtained from the complexity index values 
using a prescribed function, a target value of 
the quantity of the coded data is set as a target 
data quantity, and quantization characteristic 
information showing characteristics of quanti- 
zation for decision of the quantization scale is 
set; and 

in the quantization scale decision step, the 
modified quantization scale is decided on the 
basis of the quantization scale modification 
parameters, the weighting parameters, the 
quantization characteristic information, and the 



target data quantity which are set in the control 
information set step. 

13. An image decoding method for decoding coded 
5 image data to obtain an image, comprising : 

variable-length decoding step of decoding 
coded image data to generate a transformed 
and quantized image, reference image infor- 

w mation, and a modified quantization scale; 

inverse quantization step of performing inverse 
quantization to the transformed and quantized 
image using the modified quantization scale, 
thereby to obtain an inversely quantized image; 

15 inverse image transform step of performing 

inverse transform to the inversely quantized 
image, thereby to obtain an inversely trans- 
formed image; 

addition step of generating a decoded image 
20 using the inversely transformed image and a 

reference image which is generated in an 
image storage step described later; and 
image storage step of storing the decoded 
image for a prescribed period of time, and gen- 
25 erating a reference image from the stored 

decoded image and the reference image infor- 
mation generated in the variable-length decod- 
ing step; 

wherein the coded data obtained by the 
so image coding method according to claim 8 is 

processed as the coded image data. 

14. A method for transmitting coded image data, 
wherein the coded image data are coded data proc- 

35 essed in the image coding method according to 
claim 8. » 

15. A recording medium containing an image coding 
program for coding an input image per coding unit, 

40 which is obtained by dividing an original digital 
image in coding units, thereby to obtain coded data, 
said image coding program comprising: 

subtraction step of providing a difference image 
45 between the input image per coding unit and a 

reference image generated from a coded 
image which has already been coded; 
image transform step of receiving, as an input 
image to be transformed, one of the input 
so image per coding unit and the difference 

image, and performing a prescribed transfor- 
mation process to the input image to be trans- 
formed, thereby to obtain a transformed image; 
quantization step of quantizing the transformed 
55 image by one of a prescribed quantization 

scale and a modified quantization scale which 
is decided in a quantization scale decision step 
described later, thereby to obtain transformed 
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and quantized coeMPrtts; 
coding step of coding the transformed and 
quantized coefficients to generate coded data; 
local characteristic value calculation step of 
obtaining a complexity index value from the 
input image to be transformed and, using the 
complexity index value, calculating local char- 
acteristic values which are used for modifica- 
tion of the quantization scale; 
control information set step of setting control 
information which is used for modification of 
the quantization scale; and 
quantization scale decision step of modifying 
the quantization scale using the quantity of the 
coded data generated in the coding step, the 
local characteristic values calculated in the 
local characteristic value calculation step, and 
the control information set in the control infor- 
mation set step, thereby to decide a modified 
quantization scale. 

16. The recording medium of claim 15 wherein: 

the local characteristic value calculation step of 
the image coding program is a parameter cal- 
culation step in which quantization scale modi- 
fication parameters are calculated on the basis 
of the complexity index values, an image signif- 
icance decision result is obtained as a result of 
comparison of the complexity index value of 
each input image to be transformed with a pre- 
scribed value, and a significant image area 
ratio is obtained, which ratio shows the number 
of the input images to be transformed whose 
image significance decision results are "signifi- 
cant"; 

in the control information set step of the image 
coding program, a target value of the quantity 
of the coded data is set as a target data quan- 
tity; and 

in the quantization scale decision step of the 
image coding program, the modified quantiza- 
tion scale is decided on the basis of the target 
data quantity set in the control information set 
step, and the quantization scale parameters, 
the significant image area ratio and the image 
significance decision result which are calcu- 
lated in the parameter calculation step. 

17. The recording medium of claim 15 wherein: 

the local characteristic value calculation step of 
the image coding program is a complexity cal- 
culation step in which a complexity mean value 
is obtained as an average of the complexity 
index values, an image significance decision 
result is obtained as a result of comparison of 
the complexity index value of each input image 



to be transformed ^^Bprescribed value, and 
a significant image a^aratio is obtained, which 
ratio shows the number of the input images to 
be transformed whose image significance deci- 
5 sion results are "significant"; 

in the control information set step of the Image 
coding program, a target value of the quantity 
of the coded data is set as a target data quan- 
tity, and a complexity mean value and a signifi- 
10 cant image area ratio are set on the basis of 

control information including the complexity 
mean value and the significant image area 
ratio; and 

in the quantization scale decision step of the 
is image coding program, a modified quantization 

scale is decided on the basis of quantization 
scale modification parameters calculated from 
the complexity index values, and the complex- 
ity mean value, the significant image area ratio 
20 and the target data quantity which are set in the* 

control information set step. 

18. The recording medium of claim 15 wherein: 

25 the local characteristic value calculation step of 

the image coding program is a parameter cal- 
culation step in which a complexity mean value 
is obtained as an average of the complexity 
index values with respect to the original image, 

30 modulation parameters are obtained from the 

statistical characteristics of the complexity 
index values, weighting parameters are 
obtained from the complexity index values 
using a prescribed function, quantization scale 

35 modification parameters are calculated using 

the complexity index values, the complexity 
index mean value, and the modulation parame- 
ters, and the weighting parameters and the 
quantization scale modification parameters are 

40 generated so that these parameters can be 

used in the quantization scale decision step; 
in the control information set step of the image 
coding program, a target value of the quantity 
of the coded data is set as a target data quan- 

45 tity, quantization characteristic information 

showing quantization characteristics for deci- 
sion of the quantization scale is set, and the 
target data quantity and the quantization char- 
acteristic information are output so that these 

so can be used in the quantization scale decision 

step; and 

in the quantization scale decision step of the 
image coding program, the modified quantiza- 
tion scale is decided on the basis of the quanti- 
55 zation seal e modification parameters 

calculated in the parameter calculation step, 
and the quantization characteristic information 
and the target data quantity which are set in the 
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19. The recording medium of claim 15 wherein: 



control information set step. 



wherein the coded data obtained by the 
image coding method according to claim 8 is 
processed as the coded image data. 



in the control information set step of the image s 
coding program, on the basis of the complexity 
index values being the control information, a 
complexity mean value is obtained as an aver- 
age of the complexity index values with respect 
to the original image, modulation parameters 10 
are obtained from the statistical characteristics 
of the complexity index values, quantization 
scale modification parameters are calculated 
using the complexity index values, the com- 
plexity mean value, and the modulation param- is 
eters. weighting parameters are obtained from 
the complexity index values using a prescribed 
function, a target value of the quantity of the 
coded data is set as a target data quantity, and 
quantization characteristic information showing 20 
characteristics of quantization for decision of 
the quantization scale is set; and 
in the quantization scale decision step of the 
image coding program, the modified quantiza- 
tion scale is decided on the basis of the quanti- 2s 
zation scale modification parameters, the 
weighting parameters, the quantization charac- 
teristic information, and the target data quantity 
which are set in the control information set 
step. 30 

20. A recording medium containing an image decoding 
program for decoding coded image data to obtain 
an image, said image decoding program compris- 
ing: 35 

variable-length decoding step of decoding 
coded image data to generate a transformed 
and quantized image, reference image infor- 
mation, and a modified quantization scale; 40 
inverse quantization step of performing inverse 
y quantization to the transformed and quantized 
. ' image using the modified quantization scale, 
thereby to obtain an inversely quantized image; 
inverse image transform step of performing 45 
inverse transform to the inversely quantized 
image, thereby to obtain an inversely trans- 
formed image; 

addition step of generating a decoded image 
using the inversely transformed image and a so 
reference image which is generated in an 
image storage step described later ; and 
image storage step of storing the decoded 
image for a prescribed period of time, and gen- 
erating a reference image from the stored ss 
decoded image and the reference image infor- 
mation generated in the variable-length decod- 
ing step; 
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